High-Dimensional Quantile Regression: Convolution Smoothing and Concave Regularization
نویسندگان
چکیده
Abstract ? 1 -penalized quantile regression (QR) is widely used for analysing high-dimensional data with heterogeneity. It now recognized that the ?1-penalty introduces non-negligible estimation bias, while a proper use of concave regularization may lead to estimators refined convergence rates and oracle properties as signal strengthens. Although folded penalized M-estimation strongly convex loss functions have been well studied, extant literature on QR relatively silent. The main difficulty piecewise linear: it non-smooth has curvature concentrated at single point. To overcome lack smoothness strong convexity, we propose study convolution-type smoothed iteratively reweighted ?1-regularization. resulting empirical twice continuously differentiable (provably) locally high probability. We show ?1-penalized estimator, after few iterations, achieves optimal rate convergence, moreover, property under an almost necessary sufficient minimum strength condition. Extensive numerical studies corroborate our theoretical results.
منابع مشابه
High-Dimensional Structured Quantile Regression
Quantile regression aims at modeling the conditional median and quantiles of a response variable given certain predictor variables. In this work we consider the problem of linear quantile regression in high dimensions where the number of predictor variables is much higher than the number of samples available for parameter estimation. We assume the true parameter to have some structure character...
متن کاملSemiparametric Quantile Regression with High-dimensional Covariates.
This paper is concerned with quantile regression for a semiparametric regression model, in which both the conditional mean and conditional variance function of the response given the covariates admit a single-index structure. This semiparametric regression model enables us to reduce the dimension of the covariates and simultaneously retains the flexibility of nonparametric regression. Under mil...
متن کاملConvex Regularization for High-Dimensional Tensor Regression
In this paper we present a general convex optimization approach for solving highdimensional tensor regression problems under low-dimensional structural assumptions. We consider using convex and weakly decomposable regularizers assuming that the underlying tensor lies in an unknown low-dimensional subspace. Within our framework, we derive general risk bounds of the resulting estimate under fairl...
متن کاملOn kernel smoothing for extremal quantile regression
Nonparametric regression quantiles obtained by inverting a kernel estimator of the conditional distribution of the response are long established in statistics. Attention has been, however, restricted to ordinary quantiles staying away from the tails of the conditional distribution. The purpose of this paper is to extend their asymptotic theory far enough into the tails. We focus on extremal qua...
متن کاملGlobally Adaptive Quantile Regression with Ultra-high Dimensional Data.
Quantile regression has become a valuable tool to analyze heterogeneous covaraite-response associations that are often encountered in practice. The development of quantile regression methodology for high dimensional covariates primarily focuses on examination of model sparsity at a single or multiple quantile levels, which are typically prespecified ad hoc by the users. The resulting models may...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of The Royal Statistical Society Series B-statistical Methodology
سال: 2021
ISSN: ['1467-9868', '1369-7412']
DOI: https://doi.org/10.1111/rssb.12485